Satisfaction With Primary Care Among the Foreign-Born and the General Population in Finland: A Survey-Based study.

Foreign-born people have been found to be less satisfied with health care than native populations across countries. However, studies on differences in satisfaction with treatment between different foreign-born groups are lacking. This study explores differences in satisfaction with primary health care between the foreign-born population from different regions of origins and the general population of Finland. The study uses survey data on foreign-born population (n = 2708) and general population (n = 6671) living in Finland who report using health services. Satisfaction with experienced respect for privacy during treatment, benefit of treatment and smoothness of treatment are predicted by region of origin using logistic regression. Almost all foreign-born groups were less likely to consider treatment appointments beneficial as compared to the general population. Some foreign-born groups (people from Southeast Asia and South and Central Asia) were more satisfied with smoothness of care compared to general population. People from East Asia were less likely than the general population to consider that their privacy had been respected during the examinations and treatment. While we made the positive finding of high overall satisfaction with treatment, we also found important differences between groups. In particular, appointments were found less useful among the foreign-born population. Perceived unusefulness of treatment might lead to underuse of health care, which might result in accumulation of untreated health problems. The results point toward potential development points in the health care system. Addressing these issues might help decrease health disparities between population groups.

Citizens Access to Health Information in National Portals in the Nordic Countries.

National eHealth portals for citizens are available in the five Nordic countries. This study describes and compares the Nordic citizen portals and identifies variations in content access and functionality. The findings suggest that availability of information and services depend on the organisation of the health system, the connection to national health information exchange platforms and incentives for providing data and services.

Privacy concerns among the users of a national patient portal: A cross-sectional population survey study.

INTRODUCTION: Seeking and receiving care requires disclosure of personal information which is recorded as health data in electronic health records. Thereafter, restricting the flow of information is dependent on data protection, information security, ethical conduct, and law. Privacy concerns may arise as patients' options concerning privacy have been balanced to cater both the privacy of patients and the needs of healthcare, as well as secondary use of data. METHODS: This study examined privacy concerns among the users of a national patient portal in a representative sample of Finnish adults aged 20 to 99 years old (n = 3,731). We used logistic regression analysis with population weights to seek answers to which factors are associated with privacy concerns. The cross-sectional survey data was collected in 2020. RESULTS: Every third patient portal user had privacy concerns. Those who were 50 to 59 years old (p = 0.030) had privacy concerns more often than 20 to 49-year-olds. Those who had financial difficulties (p = 0.003) also had privacy concerns more often while those, who had good digital skills (p=<0.026), did not need guidance on telehealth service use (p=<0.001) and found telehealth service use to be beneficial (p = 0.008), had privacy concerns less often. CONCLUSION: The usefulness of telehealth seems to play an important role in privacy concerns. Another important factor is the skills required to use telehealth services. We encourage providing guidance to those who lack the necessary skills for telehealth service use. We also encourage putting effort not only into data protection and information security measures of telehealth services, but also into providing transparent and comprehensible privacy information for the service users as privacy concerns are common.

Associations of perceived changes in work due to digitalization and the amount of digital work with job strain among physicians: a national representative sample.

BACKGROUND: Physicians' work is often stressful. The digitalization of healthcare aims to streamline work, but not all physicians have experienced its realization. We examined associations of perceived changes in work due to digitalization and the amount of digital work with job strain among physicians. The moderating role of the length of work experience was investigated for these associations. METHODS: We used representative survey data on Finnish physicians' (N = 4271) experiences of digitalization from 2021. The independent variables included perceptions on statements about work transformations aligned with digitalization goals, and the extent that information systems and teleconsultations were utilized. Stress related to information systems (SRIS), time pressure, and psychological stress were the dependent variables. We analyzed the associations using multivariable linear and logistic regressions. RESULTS: Respondents had a mean SRIS score of 3.5 and a mean time pressure score of 3.7 on a scale of 1-5. Psychological stress was experienced by 60%. Perceptions associated with higher SRIS comprised disagreements with statements asserting that digitalization accelerates clinical encounters (b = .23 [95% CI: .16-.30]), facilitates access to patient information (b = .15 [.07-.23]), and supports decision-making (b = .11 [.05-.18]). Disagreement with accelerated clinical encounters (b = .12 [.04-.20]), and agreements with patients' more active role in care (b = .11 [.04-.19]) and interprofessional collaboration (b = .10 [.02-.18]) were opinions associated with greater time pressure. Disagreeing with supported decision-making (OR = 1.26 [1.06-1.48]) and agreeing with patients' active role (OR = 1.19 [1.02-1.40]) were associated with greater psychological stress. However, perceiving improvements in the pace of clinical encounters and access to patient information appeared to alleviate job strain. Additionally, extensive digital work was consistently linked to higher strain. Those respondents who held teleconsultations frequently and had less than 6 years of work experience reported the greatest levels of time pressure. CONCLUSIONS: Physicians seem to be strained by frequent teleconsultations and work that does not meet the goals of digitalization. Improving physicians' satisfaction with digitalization through training specific to the stage of career and system development can be crucial for their well-being. Schedules for digital tasks should be planned and allocated to prevent strain related to achieving the digitalization goals.

Nurses' Informatics Competency Assessment of Health Information System Usage: A Cross-sectional Survey.

Nurses' informatics competencies are nurses' professional requirements to guarantee the quality of patient care and affect nurses' use of health information systems. The purpose of this survey was to describe nurses' perceptions of their informatics competencies regarding health information system usage. A previously tested web-based questionnaire with multiple-choice questions was sent to nurses whose e-mail address was available through three Finnish Nursing Associations (N = 58 276). A total of 3610 nurses working in Finland responded. Both descriptive and explanatory statistics were used to analyze the data. The three dependent variables "nursing documentation," "digital environment," and "ethics and data protection" were formulated from the data. Nurses' overall informatics competency was good. The "ethics and data protection" competency score was higher than that of "nursing documentation" or "digital environment." Recently graduated nurses and nurses working in outpatient care, virtual hospital, examination, or operation had highest "digital environment" competency score. Health information system experience was associated with "nursing documentation." Nurses are highly qualified health information systems users. However, the competency requirements generated by rapidly expanding digitalization have challenged nurses. It is important to increase educational programs for nurses of how to use digital devices, and how to support patients to use digital services.

Perceived benefits of digital health and social services among older adults: A population-based cross-sectional survey.

Objective: The aim of this study was to describe the benefits of digital health and social services perceived by older adults and to examine factors associated with perceiving these benefits. Several factors related to (a) sociodemographic characteristics, (b) area of residence, (c) physical, cognitive, psychological, and social functioning, and (d) Internet use, were examined. Methods: The present sample included 8019 respondents aged between 75 and 99 years. The inverse probability weighting method was used to correct for bias. Linear regression analyses were used to examine the associations. Results: The ease of use of the services regardless of the time and location was perceived as the most beneficial. Convenient distance to local health or social services (parameter estimate = 0.15 [0.08-0.23]), good functional ability (PE = 0.08 [0.01-0.14]), good vision (PE = 0.15 [0.04-0.25]), ability to learn (PE = 0.05 [0.01-0.10]) and living with someone (PE = 0.08 [95% CI 0.04-0.13]) were associated with perceiving more benefits. In addition, access to the Internet (PE = 0.12 [0.06-0.19]) and independent use of the Internet (PE = 0.23 [0.17-0.29]) were associated with perceiving more benefits. Conclusions: Older adults who are healthier, have a social relationship in their everyday life or have easier access to traditional services seem to perceive more benefits from digital health and social services. Digital services should be developed to correspond with special needs caused by disadvantages in health and the social environment. To facilitate the use of digital health and social services, more efforts should be made to enhance older adults' perceptions of their benefits.

Factors associated with use of wearable technology to support activity, well-being, or a healthy lifestyle in the adult population and among older adults.

The use of wearable technology, which is often acquired to support well-being and a healthy lifestyle, has become popular in Western countries. At the same time, healthcare is gradually taking the first steps to introduce wearable technology into patient care, even though on a large scale the evidence of its' effectiveness is still lacking. The objective of this study was to identify the factors associated with use of wearable technology to support activity, well-being, or a healthy lifestyle in the Finnish adult population (20-99) and among older adults (65-99). The study utilized a cross-sectional population survey of Finnish adults aged 20 and older (n = 6,034) to analyse non-causal relationships between wearable technology use and the users' characteristics. Logistic regression models of wearable technology use were constructed using statistically significant sociodemographic, well-being, health, benefit, and lifestyle variables. Both in the general adult population and among older adults, wearable technology use was associated with getting aerobic physical activity weekly according to national guidelines and with marital status. In the general adult population, wearable technology use was also associated with not sleeping enough and agreeing with the statement that social welfare and healthcare e-services help in taking an active role in looking after one's own health and well-being. Younger age was associated with wearable technology use in the general adult population but for older adults age was not a statistically significant factor. Among older adults, non-use of wearable technology went hand in hand with needing guidance in e-service use, using a proxy, or not using e-services at all. The results support exploration of the effects of wearable technology use on maintaining an active lifestyle among adults of all ages.

Nursing informatics competence profiles and perceptions of health information system usefulness among registered nurses: A latent profile analysis.

AIMS: To identify different nursing informatics competence (NIC) profiles in nurses, examine the factors associated with profile memberships and examine the associations of the derived profiles with the nurses' perception of the usefulness of a health information system (HIS). DESIGN: A cross-sectional study. METHODS: A sample of 3610 registered nurses responded to a nationwide survey in March 2020. A latent profile analysis was performed to identify NIC profiles based on three competence areas: nursing documentation, working in digital environment, and ethics and data protection. A multinomial logistic regression was carried out to examine the associations of demographic and background variables with the profile membership. Linear regression analyses were carried out to examine the association between the profile membership and perceived HIS usefulness. RESULTS: Three NIC profiles were identified and labelled as low, moderate and high competence groups. A younger age, recent graduation year, sufficient orientation and high-rated proficiency as an HIS user were associated with nurses belonging to a high or moderate competence group relative to a low competence group. Competence group membership was associated with perceived HIS usefulness. The high competence group consistently expressed the highest usefulness of the HIS and the low competence group the lowest. CONCLUSION: Tailored training and support should be provided for nurses with different levels of informatics competence, thereby facilitating their ability to respond to increasingly digitalized work. This could contribute to higher usefulness of the HIS in terms of supporting the nurses' work tasks and promoting the quality of care. IMPACT: This was the first study exploring latent profiles of informatics competence in nurses. Insights from this study are useful for nursing management to identify different competence profiles of their employees, provide support and training to meet their needs, and promote the successful use of an HIS.

Implementation, Adoption and Use of the Kanta Services in Finland 2010-2022.

Nationwide implementation and adoption of the Prescription Centre and the Patient Data Repository services required 5.5 years since May 2010 in Finland. The Clinical Adoption Meta-Model (CAMM) was applied in the post-deployment assessment of the Kanta Services in its four dimensions (availability, use, behavior, clinical outcomes) over time. The CAMM results on the national level in this study suggest 'Adoption with Benefits' as the most appropriate CAMM archetype.

Nurse Managers' Opinions of Information System Support for Performance Management: A Correlational Study.

BACKGROUND: Current information systems do not effectively support nurse managers' duties, such as reporting, resource management, and assessing clinical performance. Few performance management information systems are available and features in many are scattered. OBJECTIVES: The purpose of the study was to determine nurse managers' opinions of information system support for performance management. METHODS: An online questionnaire was used to collect data from nurse managers (n = 419). Pearson's correlation coefficients and linear regression were used to examine the relationships between variables, which were nurse managers' ability to manage resources, to report and evaluate productivity, and to assess nursing performance and clinical procedures. RESULTS: More than half of the managers used performance management systems daily. Managers (60%) felt that they can use information systems to follow the use of physical resources, and in general (63%), they felt that it is easy to perform searches with the systems used for following up activity. Nurse managers' ability to manage resources, to report productivity, and to assess nursing care performance were correlated significantly with each other. CONCLUSION: Currently, managers have to collect data from various systems for management purposes, as system integration does not support performance data collection. The availability of continuous in-service training had a positive effect on information system use.

Satisfaction with access to health services among foreign-born population in Finland: a survey-based study.

BACKGROUND: Many European studies have shown migrants to be less satisfied with health care and find it less accessible than the general populations. The aim of this study was to compare satisfaction with access to health care between migrants from different regions of origin and the general population of Finland. METHODS: This study uses data from two comprehensive survey samples on health and wellbeing of the foreign-born and the general population living in Finland. Three aspects of satisfaction with health care access were measured and predicted by region of origin using logistic regression. RESULTS: Foreign-born population was slightly more dissatisfied with all aspects of the access to health care as compared to the general population. In all aspects of access, migrants from the Middle East and Africa were least likely to be satisfied. CONCLUSIONS: As the satisfaction with access was lowest among migrant groups which are likely to have higher needs for at least some health services in comparison to the general population, these results are alarming. More research is needed to identify the potential development points in the health care system of Finland.

The Factors Associated With Nonuse of and Dissatisfaction With the National Patient Portal in Finland in the Era of COVID-19: Population-Based Cross-sectional Survey.

BACKGROUND: In the abnormal circumstances caused by the COVID-19 pandemic, patient portals have supported patient empowerment and engagement by providing patients with access to their health care documents and medical information. However, the potential benefits of patient portals cannot be utilized unless the patients accept and use the services. Disparities in the use of patient portals may exacerbate the already existing inequalities in health care access and health outcomes, possibly increasing the digital inequality in societies. OBJECTIVE: The aim of this study is to examine the factors associated with nonuse of and dissatisfaction with the Finnish nationwide patient portal My Kanta Pages among the users of health care services during the COVID-19 outbreak. Several factors related to sociodemographic characteristics, health, and the use of health care services; experiences of guidance concerning electronic services; and digital skills and attitudes were evaluated. METHODS: A national population survey was sent using stratified sampling to 13,200 Finnish residents who had reached the age of 20 years. Data were collected from September 2020 to February 2021 during the COVID-19 pandemic. Respondents who had used health care services and the internet for transactions or for searching for information in the past 12 months were included in the analyses. Bivariate logistic regression analyses were used to examine the adjusted associations of respondent characteristics with the nonuse of My Kanta Pages and dissatisfaction with the service. The inverse probability weighting (IPW) method was applied in all statistical analyses to correct for bias. RESULTS: In total, 3919 (64.9%) of 6034 respondents were included in the study. Most respondents (3330/3919, 85.0%) used My Kanta Pages, and 2841 (85.3%) of them were satisfied. Nonusers (589/3919, 15%) were a minority among all respondents, and only 489 (14.7%) of the 3330 users were dissatisfied with the service. Especially patients without a long-term illness (odds ratio [OR] 2.14, 95% CI 1.48-3.10), those who were not referred to electronic health care services by a professional (OR 2.51, 95% CI 1.70-3.71), and those in need of guidance using online social and health care services (OR 2.26, 95% CI 1.41-3.65) were more likely nonusers of the patient portal. Perceptions of poor health (OR 2.10, 95% CI 1.51-2.93) and security concerns (OR 1.87, 95% CI 1.33-2.62) were associated with dissatisfaction with the service. CONCLUSIONS: Patients without long-term illnesses, those not referred to electronic health care services, and those in need of guidance on the use of online social and health care services seemed to be more likely nonusers of the Finnish nationwide patient portal. Moreover, poor health and security concerns appeared to be associated with dissatisfaction with the service. Interventions to promote referral to electronic health care services by professionals are needed. Attention should be targeted to information security of the service and promotion of the public's confidence in the protection of their confidential data.

Electronic Health Record Implementations and Insufficient Training Endanger Nurses' Well-being: Cross-sectional Survey Study.

BACKGROUND: High expectations have been set for the implementations of health information systems (HIS) in health care. However, nurses have been dissatisfied after implementations of HIS. In particular, poorly functioning electronic health records (EHRs) have been found to induce stress and cognitive workload. Moreover, the need to learn new systems may require considerable effort from nurses. Thus, EHR implementations may have an effect on the well-being of nurses. OBJECTIVE: This study aimed to examine the associations of EHR-to-EHR implementations and the sufficiency of related training with perceived stress related to information systems (SRIS), time pressure, and cognitive failures among registered nurses. Moreover, we examined the moderating effect of the employment sector (hospital, primary care, social services, and others) on these associations. METHODS: This study was a cross-sectional survey study of 3610 registered Finnish nurses in 2020. EHR implementation was measured by assessing whether the work unit of each respondent had implemented or will implement a new EHR (1) within the last 6 months, (2) within the last 12 months, (3) in the next 12 months, and (4) at no point within the last 12 months or in the forthcoming 12 months. The associations were examined using analyses of covariance adjusted for age, gender, and employment sector. RESULTS: The highest levels of SRIS (adjusted mean 4.07, SE 0.05) and time pressure (adjusted mean 4.55, SE 0.06) were observed among those who had experienced an EHR implementation within the last 6 months. The lowest levels of SRIS (adjusted mean 3.26, SE 0.04), time pressure (adjusted mean 4.41, SE 0.05), and cognitive failures (adjusted mean 1.84, SE 0.02) were observed among those who did not experience any completed or forthcoming implementations within 12 months. Nurses who perceived that they had received sufficient implementation-related training experienced less SRIS (F1=153.40, P<.001), time pressure (F1=80.95, P<.001), and cognitive failures (F1=34.96, P<.001) than those who had received insufficient training. Recent implementations and insufficient training were especially strongly associated with high levels of SRIS in hospitals. CONCLUSIONS: EHR implementations and insufficient training related to these implementations may endanger the well-being of nurses and even lead to errors. Thus, it is extremely important for organizations to offer comprehensive training before, during, and after implementations. Moreover, easy-to-use systems that allow transition periods, a re-engineering approach, and user involvement may be beneficial to nurses in the implementation process. Training and other improvements would be especially important in hospitals.

The Association Between Using a Mobile Version of an Electronic Health Record and the Well-Being of Nurses: Cross-sectional Survey Study.

BACKGROUND: Mobile devices such as tablets and smartphones are increasingly being used in health care in many developed countries. Nurses form the largest group in health care that uses electronic health records (EHRs) and their mobile versions. Mobile devices are suggested to promote nurses' workflow, constant updating of patient information, and improve the communication within the health care team. However, little is known about their effect on nurses' well-being. OBJECTIVE: This study aimed to examine the association between using a mobile version of the EHR and nurses' perceived time pressure, stress related to information systems, and self-rated stress. Moreover, we examined whether mobile device use modifies the associations of EHR usability (ease of use and technical quality), experience in using EHRs, and number of systems in daily use with these well-being indicators. METHODS: This was a cross-sectional population-based survey study among 3610 Finnish registered nurses gathered in 2020. The aforesaid associations were examined using analyses of covariance and logistic regression adjusted for age, gender, and employment sector (hospital, primary care, social service, and other). RESULTS: Nurses who used the mobile version of their EHR had higher levels of time pressure (F1,3537=14.96, P<.001) and stress related to information systems (F1,3537=6.11, P=.01), compared with those who did not use mobile versions. Moreover, the interactions of mobile device use with experience in using EHRs (F1,3581=14.93, P<.001), ease of use (F1,3577=10.16, P=.001), and technical quality (F1,3577=6.45, P=.01) were significant for stress related to information systems. Inexperience in using EHRs, low levels of ease of use, and technical quality were associated with higher stress related to information systems and this association was more pronounced among those who used mobile devices. That is, the highest levels of stress related to information systems were perceived among those who used mobile devices as well as among inexperienced EHR users or those who perceived usability problems in their EHRs. CONCLUSIONS: According to our results, it seems that at present mobile device use is not beneficial for the nurses' well-being. In addition, mobile device use seems to intensify the negative effects of usability issues related to EHRs. In particular, inexperienced users of EHRs seem to be at a disadvantage when using mobile devices. Thus, we suggest that EHRs and their mobile versions should be improved such that they would be easier to use and would better support the nurses' workflow (eg, improvements to problems related to small display, user interface, and data entry). Moreover, additional training on EHRs, their mobile versions, and workflow related to these should be provided to nurses.

The Associations of Electronic Health Record Usability and User Age With Stress and Cognitive Failures Among Finnish Registered Nurses: Cross-Sectional Study.

BACKGROUND: Electronic health records (EHRs) are expected to provide many clinical and organizational benefits. Simultaneously, the end users may face unintended consequences, such as stress and increased cognitive workload, due to poor EHR usability. However, whether the effects of usability depend on end user characteristics, such as career stage or age, remains poorly understood. OBJECTIVE: The objective of this study was to examine the associations of EHR usability and user age with stress related to information systems and cognitive failures among registered nurses. METHODS: A cross-sectional survey design was employed in Finland in 2017. A total of 3383 registered nurses responded to the nationwide electronic survey. Multiple linear regression was used to examine the associations of EHR usability (eg, how easily information can be found and a patient's care can be documented) and user age with stress related to information systems and cognitive failures. Interaction effects of EHR usability and age were also tested. Models were adjusted for gender and employment sector. RESULTS: Poor EHR usability was associated with higher levels of stress related to information systems (ß=.38; P<.001). The strength of the association did not depend on user age. Poor EHR usability was also associated with higher levels of cognitive failures (ß=.28; P<.001). There was a significant interaction effect between age and EHR usability for cognitive failures (ß=.04; P<.001). Young nurses who found the EHR difficult to use reported the most cognitive failures. CONCLUSIONS: Information system stress due to poor EHR usability afflicts younger and older nurses alike. However, younger nurses starting their careers may be more cognitively burdened if they find EHR systems difficult to use compared to older nurses. Adequate support in using the EHRs may be particularly important to young registered nurses, who have a lot to learn and adopt in their early years of practice.

Usability Factors Associated With Physicians' Distress and Information System-Related Stress: Cross-Sectional Survey.

BACKGROUND: Constantly changing and difficult-to-use information systems have arisen as a significant source of stress in physicians' work. Physicians have reported several usability problems, system failures, and a lack of integration between the systems and have experienced that systems poorly support the documentation and retrieval of patient data. This stress has kept rising in the 21st century, and it seems that it may also affect physicians' well-being. OBJECTIVE: This study aimed to examine the associations of (1) usability variables (perceived benefits, technical problems, support for feedback, and user-friendliness), (2) the number of systems in daily use, (3) experience of using information systems, and (4) participation in information systems development work with physicians' distress and levels of stress related to information systems (SRIS) levels. METHODS: A cross-sectional survey was conducted among 4018 Finnish physicians (64.82%, 2572 out of 3968 women) aged between 24 and 64 years (mean 46.8 years) in 2017. The analyses of covariance were used to examine the association of independent variables with SRIS and distress (using the General Health Questionnaire) adjusted for age, gender, employment sector, specialization status, and the electronic health record system in use. RESULTS: High levels of technical problems and a high number of systems in daily use were associated with high levels of SRIS, whereas high levels of user-friendliness, perceived benefits, and support for feedback were associated with low levels of SRIS. Moreover, high levels of technical problems were associated with high levels of psychological distress, whereas high levels of user-friendliness were associated with low distress levels. Those who considered themselves experienced users of information systems had low levels of both SRIS and distress. CONCLUSIONS: It seems that by investing in user-friendly systems with better technical quality and good support for feedback that professionals perceive as being beneficial would improve the work-related well-being and overall well-being of physicians. Moreover, improving physicians' skills related to information systems by giving them training could help to lessen the stress that results from poorly functioning information systems and improve physicians' well-being.

Experienced time pressure and stress: electronic health records usability and information technology competence play a role.

BACKGROUND: Electronic health records (EHRs) are an elementary part of the work of registered nurses (RNs) in healthcare. RNs are the largest group of healthcare workers, and their experiences with EHRs and their informatics competence play a crucial role in a fluent workflow. The present study examined EHR usability factors and nurses' informatics competence factors related to self-reported time pressure and psychological distress. METHODS: A nationwide survey was conducted for working-age registered nurses in 2017. The study sample included 3607 nurses (5% men) in Finland. The association of age, sex, employment sector, EHR usability factors, and nurses' informatics competence factors with time pressure and psychological distress were examined with analyses of covariance. RESULTS: The EHR usability factors that were associated with high time pressure were low EHR reliability and poor user-friendliness. Regarding the nurses' informatics competence factors, only low e-Care competence was associated with time pressure. Of the EHR usability factors, low EHR reliability and low support for cooperation were associated with high psychological distress. Of the nurses' informatics competence factors, low e-Care competence was associated with high psychological distress. CONCLUSIONS: Unreliability and poor user-friendliness of EHRs seem to be prominent sources of time pressure and psychological distress among registered nurses. User-friendly EHR systems and digital tools in healthcare are needed. Nurses' competence to use eHealth tools to tailor patient care should be strengthened through organizational and regional actions. For example, house rules about how to use eHealth tools and instructions on common practices in cooperation with other organizations could be useful.

Artificial Intelligence in Clinical Decision Support: Challenges for Evaluating AI and Practical Implications.

OBJECTIVES: This paper draws attention to: i) key considerations for evaluating artificial intelligence (AI) enabled clinical decision support; and ii) challenges and practical implications of AI design, development, selection, use, and ongoing surveillance. METHOD: A narrative review of existing research and evaluation approaches along with expert perspectives drawn from the International Medical Informatics Association (IMIA) Working Group on Technology Assessment and Quality Development in Health Informatics and the European Federation for Medical Informatics (EFMI) Working Group for Assessment of Health Information Systems. RESULTS: There is a rich history and tradition of evaluating AI in healthcare. While evaluators can learn from past efforts, and build on best practice evaluation frameworks and methodologies, questions remain about how to evaluate the safety and effectiveness of AI that dynamically harness vast amounts of genomic, biomarker, phenotype, electronic record, and care delivery data from across health systems. This paper first provides a historical perspective about the evaluation of AI in healthcare. It then examines key challenges of evaluating AI-enabled clinical decision support during design, development, selection, use, and ongoing surveillance. Practical aspects of evaluating AI in healthcare, including approaches to evaluation and indicators to monitor AI are also discussed. CONCLUSION: Commitment to rigorous initial and ongoing evaluation will be critical to ensuring the safe and effective integration of AI in complex sociotechnical settings. Specific enhancements that are required for the new generation of AI-enabled clinical decision support will emerge through practical application.

How do health care workers manage a patient with multiple care needs from both health and social care services? - A vignette study.

INTRODUCTION: To assess how health care professionals outline the management of care and explore which health or social care professionals were involved in the patient's treatment. METHODS: A survey with a patient vignette for general practitioners (n = 31) and registered nurses (n = 31) working daily in Finnish health centres located in four cities. Respondents answered structural questions and explained in detail the care process that they tailored for the patient. The care process was examined using content analysis. RESULTS: A physician-nurse working pair was declared to be in charge of the care process by 27% of respondents, a registered nurse by 9% and a general practitioner by 11%. However, 53% reported that no single person or working pair was in charge of the care process (response rate 72%). The concluding result of the analyses of the presented process was that both treatment practices and the professionals participating in the patient's treatment varied. Collaboration with social services was occasional, and few care processes included referrals to social services. CONCLUSION: For the patient who needs both health and social care services, the management of care is a challenge. To improve the chances of patients being actively involved in making treatment plans at least three factors need to be addressed. Firstly, a written treatment plan should explicate the care process. Second, collaboration and interaction between health and social care services should be strengthened, and third, a contact person should be named to avoid care gaps in primary health care. Next-step data from patients need to be collected to get their views on care management and compare these with those from general practitioners and registered nurses.